Serial No. 10/820,906 

Response to Office Action of October 31, 2008 
Amendments to the Claims 

This listing of claims will replace all prior versions, and listings, of claims in the 
application. 

Listing of Claims: 
1-31 (canceled). 

32. (previously submitted) A system for use in managing human activity of interest within an 
enterprise, comprising a computer having a model for tracking one or more human objects in a 
scene related to the enterprise and configured to 

(i) access key activity data comprising human object data related at least to the human 
features, locations, movement patterns, and predetermined other human activity of a human 
object relative to other physically and visually distinct objects in a scene related to the enterprise, 

(ii) receive sensor data that is taken in by a sensor of a predetermined scene related to the 
enterprise, 

(iii) extract solely from the sensor data changes that enables separation of 
foreground and background objects, including human objects, localization of human object 
features, and connection of human object features that should be connected, 

(iv) classify the extracted objects, including extracted human objects, in plurality of classes 
of objects of different features, shapes, movement and behavioral patterns, 

(v) determine whether a human object is new to the human object data in the computer and 
if so initiating tracking of the new human object and if the human object exists as human object 
data in the computer updating a track of the existing human object, and update the computer 
model in accordance with the foregoing, and 

(vi) compare human object data to key activity data to determine whether to generate a key 
activity message. 

33. (previously submitted) A system as defined in claim 32, wherein the computer is configured 
to make a preliminary determination from the sensor data as whether to extract from the sensor 
data one or more human_objects and the state of activity for each human object with respect to 
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the state of activity of other physically distinct objects in the sensor data, irrespective of 
objective compliance. 

34. (previously submitted) A system as defined in claim 33, wherein in extracting from the 
sensor data the human object and the state of activity for the humanobject with respect to other 
physically distinct objects in the sensor data, irrespective of object compliance, the computer is 
configured to determine if the humanobject has been previously extracted from sensor data or is 
being initially extracted from the sensor data. 

35 (previously submitted). A system as defined in claim 34, wherein the computer is configured 
such that after the computer has processed the key activity data and the extracted human_object 
data and determined whether to produce output that is related to the key activity, the computer is 
configured to receive additional sensor data taken in by the sensor of the predetermined scene 
related to the enterprise, extract from the additional sensor data ahuman object and the state of 
activity for the humanobject with respect to the state of activity for other physically distinct 
objects in the sensor data, irrespective of object compliance, and process the key activity and the 
extracted data from the additional sensor data and determine whether to produce output that is 
related to the key activity. 

39 (previously submitted) A method for use in managing human activity of interest within an 
enterprise, comprising 

a. providing a computer configured to (i) access key activity data comprising data related 
to activity of a human object relative to other physically and visually distinct objects in a 
predetermined scene related to the enterprise, (ii) receive sensor data that is taken in by a sensor 
of a scene related to the enterprise, (iii) extract solely from the sensor data an a human object and 
the state of activity for the human object with respect to the state of activity for other physically 
and visually distinct objects in the sensor data, irrespective of object compliance, including 
separation of foreground and background objects, including human objects, localization of 
human object features, and connection of human object features that should be connected,, and 
(iv) process the key activity data and the extracted data and determine whether to produce output 
that is related to the key activity; 
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b. inputting to the computer sensor data that is taken in by a sensor of a scene related to the 
enterprise; 

c. extracting solely from the sensor data, via the computer, a human object and the state of 
activity for the human_object with respect to the state of activity for other physically and visually 
distinct objects in the sensor data, irrespective of object compliance.Jncluding_separation of 
foreground and background objects, including human objects, localization of human object 
features, and connection of human object features that should be connected; 

d. processing the key activity data and the extracted data and determine whether to produce 
output that is related to the key activity, and 

e. storing the detected activities in a database for extraction and use in a decision support 
system. 

36 (previously submitted) A method as defined in claim 39, wherein a preliminary determination 
is made, via the computer, from the sensor data as to whether to extract from the sensor data the 
human object and the state of activity for the human object with respect to the state of activity of 
other physically distinct objects in the sensor data, irrespective of objective compliance. 

37 (previously submitted) A method as defined in claim 36, wherein in extracting from the 
sensor data the human object and the state of activity for the human object in the scene with 
respect to other physically distinct objects in the sensor data, irrespective of object compliance, 
the computer determines if the human object has been previously extracted from sensor data or is 
being initially extracted from the sensor data. 

38 (previously submitted). A method as defined in claim 37, wherein after the computer has 
processed the key activity data and the extracted data and determined whether to produce output 
that is related to the key activity, the computer (i) receives additional sensor data taken in by the 
sensor of the predetermined scene related to the enterprise, (ii) extracts from the additional 
sensor data a human object and the state of activity for the human_object with respect to the state 
of activity for other physically distinct objects in the sensor data, irrespective of object 
compliance, (iii) processes the key activity and the extracted data from the additional sensor data 
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and determines whether to produce output that is related to the key activity and (iv) update the 
already stored information of the key activity of the object. 
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